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Abstract 

We prove the "strong form" of the Clemens conjecture in degree 
10. Namely, on a general quintic threefold F in P*, there are only 
finitely many smooth rational curves of degree 10, and each curve C 
is embedded in F with normal bundle 0(— 1) © 0(— 1). Moreover, 
in degree 10, there are no singular, reduced, and irreducible rational 
curves, nor any reduced, reducible, and connected curves with rational 
components on F. 

Introduction 

Almost twenty years ago, Clemens conjectured that the number of smooth 
rational curves of fixed degree on a general quintic threefold in P"^ is finite. 
In 1986, Sheldon Katz IKaJ proved Clemens' conjecture in degrees at most 7. 
His method of proof was in two steps. First he used a deformation-theoretic 
argument to show that 

Clemens ' conjecture holds for smooth rational curves C of degree d pro- 
vided the incidence scheme 

'■= {{C-,F) I F a quintic containing C} 

is irreducible. 

He then proved that is irreducible for all d < 7, by arguing that the 
fibres of its projection onto the Hilbert scheme of smooth degree-d curves 
are equidimensional projective spaces. Indeed, equidimensionality follows 
immediately from a vanishing result for ideal-sheaf cohomology of Gruson, 
Lazarsfeld, and Peskine. 
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Building on Katz's work, Johnsen and Kleiman |JKlj next showed that 
the only reduced connected curves of degree d at most 9 on i*" with rational 
components are irreducible and either smooth or six-nodal plane quintics. 
(In the meantime, Vainsencher |Vaj had discovered that there are 17,601,000 
six-nodal plane quintics on F. For a proof of the latter assertion, see |KlPij .) 
To establish that the generic threefold F contains curves of the asserted sort, 
Johnsen and Kleiman first observe that the space 

Mrf := {degree-d morphisms /: P"^ ^ P"^} 
is stratified by locally-closed subsets M^^i, where i := h^{I(j/p4{5)) and C is 
the image of /. Pulling back by iTd ■ ^ ^d-, they obtain a corresponding 
stratification of the incidence scheme into loci I^^j, and they show that 
the projection j — > j is dominant exactly over Mdfl-, where all the fibres 
are equidimensional. 

Johnsen and Kleiman apply the same result of Gruson-Lazarsfeld-Pes- 
kine used by Katz, as well as a related result of d'Almeida, to show that 
whenever the fibre dimension h^{ZQif:4,{h)) — 1 is not the expected one, then 
the curve C necessarily admits a highly-incident secant line. Smooth curves 
with high-incidence secants comprise a locally closed locus of high codimen- 
sion inside the Hilbert scheme; Johnsen and Kleiman settle Clemens' conjec- 
ture for smooth curves by obtaining appropriate bounds on the dimensions 
of the fibres T^d^{C) over this locus. 

To handle singular irreducible and reduced rational curves C, Johnsen 
and Kleiman use the same basic approach, but are forced to work harder, 
because for singular curves the arithmetic genus g{C) varies over a finite 
nonzero range. To bound this variation, they apply a classical result of 
Castelnuovo-Halphen giving the maximal possible arithmetic genus of each 
curve in terms of the dimension of the minimal linear space it spans. Next, 
they stratify low-genus curves according to the dimension of their spans, 
as well as the types of their singularities, and analyze the number of linear 
independent conditions imposed on curves in each case. By controlling the 
dimension of each stratum inside the appropriate mapping space of non- 
degenerate rational curves, they are able to conclude that the projection 
Md is never dominant over the locus of singular curves. 

Johnsen and Kleiman also show that no reducible curves lie on the gen- 
eral quintic. To do so, they bound the length of the intersections of curve 
components, and thereby obtain lower bounds for the codimension of such 
reducible curves inside the Hilbert scheme. Those bounds allow them to 
conclude. 

The next case to check, which is the subject of this work, is that of ratio- 
nal curves of degree 10. It is interesting in its relation to mirror symmetry. 
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In fact (see |CKl p.206]), the finiteness of the Hilbert scheme of degree- 10 
rational curves on the general quintic smooth implies that the instanton 
number uiq is given by 

nio = 6 X 17, 601, 000 + ^{smooth rational curves of degree 10 in F}. 

A couple of comments are in order. First of all, Clemens' original con- 
jecture predicted that only smooth rational curves lie on a general quintic 
F. Clemens' conjecture in its revised form predicts that the six-nodal plane 
quintics are the only singular, reduced, and irreducible rational curves on F. 
On the other hand, mirror symmetry includes Vainsencher's singular quin- 
tics in its count of rational curves of degree five, but fails to count six double 
covers corresponding to each of these. So we see both that 10 is the first 
d for which the instanton number rid fo-ils to count smooth rational curves 
of degree d on the general quintic F, and that the discrepancy between nio 
and the actual number of smooth rational curves is accounted for by double 
covers of nodal plane quintics. 

In this paper, we extend the results of Johnsen and Kleiman to include 
curves of degree 10. In doing so we adopt their basic strategy to show 
that the only rational, reduced, irreducible curves of degree 10 on a gen- 
eral quintic hypersurface F are smooth, and that there are only finitely 
many such smooth curves. Since the results of [tJLP are less useful than 
before, however, we are forced to use a different technique to estimate the 
dimensions of the fibres of the projection Jio Miq. In order to make our 
dimension estimates, we study the generic initial ideals which result from 
degenerations of rational curves. By a combinatorial analysis, we are able to 
control the cohomology of generic initial ideals, and deduce uniform bounds 
on h^{lQ/-p4,{5)), where C is a rational curve of degree 10. 

There are several reasons why studying the combinatorics of the generic 
initial ideal, or gin, is useful (and feasible). First, it is a monomial ideal fixed 
by the action of the group of upper triangular matrices, so it has a rather 
simple structure. In addition, its Castelnuovo-Mumford regularity is the 
same as that of (the ideal sheaf of) the curve C. Finally, the presentation 
of the generic initial ideal gin Iq for the reverse-lexicographic term order 
is closely related to the presentation of gin IcnH/H^ where H is a, general 
hyperplane. Since the general hyperplane section of a curve C is a collection 
of points in uniform position (see, for example, lEH' p. 85]), there are 
natural restrictions on the Hilbert functions and regularity properties of the 
corresponding ideals. 

By systematically using all of the preceding considerations, we are able 
to obtain relatively robust bounds on the higher cohomology of I(j/p4(5), 
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when C is the image of any map / : ^ outside a certain special locus 
inside the mapping space Miq. By combining our bounds on cohomology 
with the estimates on parameter-space dimensions given in |JKlj . we are 
able to extend the results of JKl to degree 10. To our knowledge, our 
method constitutes a new application of generic initial ideals to problem- 
solving in algebraic geometry; hopefully, it will be a useful tool for work on 
other problems, too. 

Hereafter, a "generic" quintic hypersurface in P'* means one cut out 
by a polynomial F belonging to a Zariski-dense open subset of the family 
P^-^^ of degree-5 polynomials on P^. We always work over the complex 
numbers C. Moreover, the abbreviations Xq and Xr are used in place of 
Xc/p4 and /r/psj respectively, for ideal sheaves of curves C C P*^ and their 
hyperplane sections. When we refer to the regularity of a variety X, we mean 
the Castelnuovo-Mumford regularity of the ideal sheaf, reg X := regXx- 
Similarly, whenever / is a homogeneous ideal we take H^{I) and reg / to 
mean the ith. cohomology group and the regularity, respectively, of the sheaf 
associated to /. The notation Ix,m denotes the mth graded piece of the 
homogeneous ideal Ix- Similarly, Ix\h ■ = Xx ^ Oh denotes the restriction 
of Ix to the hyperplane H. Likewise, {Ix)xn denotes U^^/x : (x^), the 
saturation of Ix with respect to the element x„. 

A minimal generator of a monomial ideal / means a monomial that is 
minimal for the partial order defined by divisibility. (A basic fact from 
commutative algebra is that every monomial ideal / admits a unique set of 
minimal generators, and these generate /.) The term genus g{C) of a one- 
dimensional scheme C always denotes arithmetic genus, that is, 1 — x{C), 
where x is the Euler characteristic of Oc ■ The degree or genus of a homoge- 
neous ideal / refers to the degree or genus of the projective scheme defined 
by /. Finally, we only consider initial ideals for the reverse-lexicographic, 
or revlex, term order, so henceforth gin / denotes the generic initial ideal 
of / with respect to reverse-lexicographic order. Revlex is distinguished 
among term orders for being "best-behaved" with regard to intersections 
with hyperplanes. (For a discussion of term orders, see ^3 Ch. 15] and 

The paper is in three sections. In section ^ we recall the basic theory 
of generic initial ideals, in order to show how to compute the basic cohomo- 
logical invariants of such ideals. To bound /i^(Xc(5)), we first describe the 
initial ideals of general hyperplane sections of irreducible curves of degree 
10, via a result of |Balj that bounds their Castelnuovo-Mumford regularity. 
Next we use a result of |BSj to relate the initial ideals of curves to those of 
their hyperplane sections. 
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In section ^ the strong form of Clemens' conjecture for irreducible ra- 
tional curves of degree 10 in is proved. To do so, we establish bounds on 
/i^(Xc(5)) case by case for rational curves C of degree 10. To conclude that 
the bounds we obtain are adequate, we appeal to a result of Verdier (see 
|Ve[ Thm., p. 139] and |Ka[ Thm.l, p. 181]) that describes the stratification 
of the space of all morphisms / : ^ of a given degree according to the 
splitting of the restricted tangent bundle /*Tp4. 

Section El extends Johnsen and Kleiman's analysis of reduced, reducible, 
and connected rational curves to cover those of degree 10. As in JKlj, we 
stratify curves according to the length of the intersection of their compo- 
nents. To bound the dimensions of these loci, we use a simple argument 
involving the relative Hilbert scheme of morphisms, in place of the argu- 
ments in local coordinates given in |.TKlj . Regularity arguments from the 
latter paper carry over, with the exception of a regularity lemma for unions 
of nodal quintics. We prove that such curves are 6-regular (so, in particular, 
they verify h^{Ic{5)) = 0) by showing their initial ideals are generated by 
polynomials of degree 6 or less. 

Many of the methods discussed in this paper carry over to degree 11; 
however, one needs to work even harder to bound h^Ic{5). In a preprint 
to be distributed shortly, the author verifies Clemens' conjecture in degree 
11, by showing that those curves which do not satisfy suitable bounds on 
h^Ic{5) necessarily lie on a large number of linearly independent hypercubics 
in P^. A liaison-theoretic argument shows that such curves necessarily lie 
on surfaces of degree at most 8, and the author concludes by showing that 
the locus of rational curves lying on such surfaces has small dimension. 
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1 Generic initial ideals 

Given any homogeneous ideal I in n + 1 variables Xj, together with a choice 
of partial order < on the monomials m{xi), the initial ideal of / with respect 
to < is, by definition, generated by leading terms of elements in /. So for 
any subscheme C of P", upper-semicontinuity implies that the regularity 
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and values of the ideal sheaf Iq are majorized by those of the (sheaf 
associated to the) initial ideal in{Zc) with respect to any partial order on 
the monomials of P". On the other hand, Macaulay's theorem establishes 
that the Hilbert functions of Ic and in(Xc) agree. If, moreover, we replace 
C by a general PGL(n + l)-translate of C, then 

reg(2c) = reg(in(Jc')), 

and in(Xc) is called the generic initial ideal of C, written gin(Xc). 

A theorem of Galligo establishes that there is a unique generic initial 
ideal associated to any ideal. Further, Bayer and Stillman showed that the 
following three statements are equivalent. 

1. The monomial ideal gin 2c is saturated, in the ideal-theoretic sense. 
In other words, for all polynomials g E gin Ic, m E (xq, • . . , Xn), 

g ■ m e gin Ic ^ g e gin Ic- 

2. The homogeneous ideal Ic is saturated. 

3. No minimal generator of gin Ic C C[xo, • • • , Xn] is divisible by Xn- 

For proofs, see |Grel Thm. 2.30]. More generally, let / C C[xo, . • • ,Xn] be 
any ideal that is Borel-fixed, i.e., fixed under the action of upper triangular 
matrices T C PGL(n + 1); then / is saturated if and only if none of its 
minimal generators is divisible by x„. Hereafter, we work exclusively with 
saturated generic initial ideals. In the subsections to follow, we reduce the 
problem of bounding h^{Ic{5)), for reduced curves C, to the problem of 
bounding h^(Ix{5)), for X belonging to a certain finite set of Borel-fixed 
ideals. We also give an explicit procedure for computing h^{Ix{5)). 

1.1 Hyperplane sections of nondegenerate irreducible curves 

In this subsection, we examine monomial ideals that arise as gins of hy- 
perplane sections, or hyperplane gins for short, of nondegenerate integral 
rational curves C of degree 10. More to the point, we examine monomial 
ideals corresponding to hyperplane gins that are general in a sense we will 
now make precise. 

Begin by fixing C. Choose general homogeneous coordinates xq, . . . ,X4 
for P'^, and set H := {x^ = 0}. Then H is a general hyperplane, whose 
intersection with C is a set of ten points in uniform position: the set's 
monodromy is the full symmetric group on ten letters. Associated to the 
saturated ideal defining COH, there is a corresponding Borel-fixed monomial 
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ideal in C[xq, . . . jX^], the saturated generic initial ideal ginZcnH- This 
ideal is invariant under general linear transformations of the coordinates 
xq, . . . ,X3. We therefore call it the hyperplane gin of C. 

As explained in the paragraphs preceding this subsection, saturatedness 
and Borel-fixity together imply that the hyperplane gin of C is minimally 
generated by monomials in the first three variables xq, xi, and X2- Moreover, 
because it cuts out a zero-dimensional scheme, gin IcnH has some minimal 
generator of the form X2 with A > 0. Indeed, if / := gin IcnH contained 
no such minimal generator, then the vanishing locus V{I) would contain a 
1-dimensional projective subspace of vectors {(0,0,0,02,03) : 01,02 € C}, 
which is absurd according to the dimension theorem |(yL()[ Thm.9.3.11] for 
monomial ideals. 

On the other hand, Borel-fixity implies the hyperplane gin is combina- 
torially simple: Recall that an ideal / is Borel-fixed if and only if for every 
monomial P, 

P* := Xi/xj ■ P belongs to / whenever i < j; 

see |Ei| Thm.15.23]. In constructing minimal generating sets for Borel-fixed 
monomial ideals, we make systematic use of this fact without mentioning it. 

Any set of minimal generators for the general hyperplane gin of C may 
be represented by a tree T, or directed graph without cycles. Namely, fix 
an alphabet A := {0, xq, xi, X2}, and consider the set of all trees with root 
vertices and all other vertices labeled by either xq, xi, or X2. Call terminal 
vertices leaves. Then the unique path from the root vertex to any leaf 
labeled x^ determines a sequence of vertices 0, Xj^ , Xjj , . . . , Xj, . (We will only 
be concerned with trees associated to nonzero ideals, so will never arise as 
a leaf.) It's natural to interpret the string polynomial of 

degree /. Likewise, if the unique path from the root vertex to a given vertex 
V involves d edges, then we say that v has degree d. A rewriting rule applied 
to a leaf v is then a formal operation on T that at v glues a certain number 
of new edges ei{v) terminating in vertices Vi{v). The result is a new tree T' 
in which the vertices Vi{v) are leaves of degree d + 1. Say that a vertex Vi 
dominates a vertex V2 if it is closer to the root vertex 0. We also stipulate 
that, if Vi with label Xj dominates Vj with label xj, then i < j. 

For each homogeneous monomial ideal /, the unique minimal generating 
set of / determines a tree T{I) whose leaves correspond to minimal gener- 
ators of /. The assignment / 1— > T{I), moreover, is unique. Therefore, we 
treat rewriting rules interchangeably as operations on either ideals or trees. 

To clarify our terminology, here are a couple of simple examples of zero- 
dimensional subschemes of and the minimal generating sets of the corre- 
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Table 1: A-rules for nondegenerate curves in 

3. XqX^X2 ^ ^^^{xj'''"'^, and an initial rule 

4. 1-^ (xo,Xi,X2). 

spending ideals. There is exactly one zero-dimensional Borel- fixed ideal of 
degree 1, namely Ii = {xq, xi, X2). Similarly, I2 = (xo,xi,X2) is the unique 
zero-dimensional Borel-fixed ideal of degree 2 . Note that a minimal gener- 
ating set for I2 may be obtained from one for Ii by exchanging the minimal 
generator X2 of Ii for the minimal generator X2 of l2- In other words, a 
set of minimal generators for I2 may be obtained from a set of minimal 
generators for Ii by replacing X2 with x| and keeping the other generators. 
The corresponding operation on trees adds a new vertex f (x^) to T(/i) and 
connects ^(xl) with the vertex v{x2) corresponding to X2 € h along a new 
edge. In other words, to obtain T(/2) from T(/i) it suffices to apply a single 
rewriting at the vertex X2, that we denote by X2 1-^ X2. 

In general, as we show in the next subsection, any hyperplane section gin 
/ of a curve may be constructed by applying a sequence of rewriting rules of 
the form Xk 1-^ ^A;+i to the "empty ideal," 0. Here is a single monomial 
and Ifc+i is a set of monomials that "replace" X^.. In other words, and 
/ fit into a sequence of monomial ideals Iq = $,..., In = I where Ik+i is 
the ideal generated by all monomial minimal generators of Ik except Xk, 
together with a set of monomials Y^+i of degree deg(Xfc) -|- 1. 

1.2 Rewriting rules for nondegenerate hyperplane gins 

Fix a nondegenerate curve C, together with a hyperplane H that is general 
in the sense that C (1 H is a collection of 10 distinct points in uniform 
position. Letting / denote the corresponding hyperplane gin, we see that / 
is a homogeneous Borel-fixed ideal in the coordinates Xi,0 < i < 3, of H . It 
follows from the discussion of subsection 1.2 that / is saturated if and only if 
none of its minimal generators is divisible by X3, and such a saturated ideal 
defines a zero-dimensional scheme if and only if some minimal generator of 
/ is of the form X2- 

Our next task is to describe a set of rewriting rules for hyperplane gins, 
or A-rules, that accounts for all possible / arising as above. A candidate 
for a complete list of A-rules is given in Tabled Before showing that it is 
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complete, a few words are in order. 

First of all, it is clear that the proposed A-rules preserve saturatedness 
and zero-dimensionality. Moreover, for every A-rule i— > Ife+i that re- 
places the ideal by /fc+i, the set of monomials Ifc+i are in fact minimal 
generators of Ik+i- Similarly, A-rules preserve Borel-fixity because the com- 
binatorial criterion that characterizes the property is satisfied at every step. 
So applying a sequence of A-rules to the set of minimal generators of a hy- 
perplane gin yields a set of minimal generators for a Borel-fixed ideal of 
dimension zero. 

As explained in the preceding subsection, it is also useful to interpret the 
A-rules graphically. Namely, applying the A-rule i— > Y^+i alters a tree 
of minimal generators for 1^ by gluing Card(yfc_|_i) new edges onto the leaf 
corresponding to Xk- Therefore, at the risk of creating additional confusion, 
we will identify leaves V with the monomial minimal generators to which 
they correspond, i.e., by the unique sequence of vertices linking to V . By 
doing so, we mean to make more transparent the correspondence between 
gluing operations on trees of minimal generators and replacement operations 
on sets of minimal generators. 

Finally we show that the A-rules comprise a complete set of rewriting 
rules for hyper plane gins. 

Lemma 1.2.1. The minimal generating set of every nondegenerate hyper- 
plane gin may he realized by applying A-rules. 

Proof. Let C and F respectively denote a nondegenerate curve C C and 
a general hyperplane section of the curve. Recall from subsection 12.21 that 
gin(/r) is Borel-fixed, and has a minimal generator of the form X2, which is 
necessarily of maximal degree among all minimal generators of gin(/r)- 

Now consider the set of leaves / of maximal degree A in T(gin(/r)). 
Letting Vd{l) denote the vertex dominating I, note that Vd{l) verifies this 
combinatorial property: if v^il) is labeled xq (resp. xi,X2), then Vd{l) dom- 
inates a 3-tuple of vertices xq,xi,X2 without omissions (resp., a pair xi,X2 
or a singleton X2). If Vd{l) is labeled X2, then the property holds trivially, 
by the conventions for trees established in the previous subsection. In the 
other two cases, the observation follows from Borel-fixity, together with the 
fact that X2 lies in gin(/r)- 

Note, moreover, that the tree obtained from T(gin(/r)) by "pruning", 
or removing all leaves of maximal degree and contracting the correspond- 
ing edges to their dominating vertices, is also Borel-fixed, saturated, and 
zero-dimensional. By induction on degree, it follows that every vertex of 
T(gin(/r)) verifies the combinatorial property of the previous paragraph. 
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Table 2: C-rules for nondegenerate irreducible curves 

1. X^- {xo,Xi,X2,X3), 

2. Xqx{ Xqx{ ■ {xi,X2,xs), and 

3. Xqx{x2 '-^ Xqx{x2 ■ {X2,X3) 

On the other hand, any tree generated by A-rules may be pruned, as 
pruning is clearly an inverse for rewriting. The same argument by induction 
on degree invoked in the preceding paragraph now shows that those trees 
obtained by A-rules are exactly those verifying the combinatorial property 
above. □ 

Now let X be any subscheme of P", and let F be a hyperplane section 
defined hy T := X D H where H is cut out by a general linear form. Make 
a general choice of coordinates xq,. . . ,Xn on P*^ with respect to which H 
is defined by Xn = 0. As explained in |Gre[ p. 163], the surjectivity of the 
restriction map 

Ix.m — > Ir,m, 
for m sufficiently large, implies that 

sat{Ix\H) = Ir- 

According to |Grel Prop. 2.21], the latter equality of ideals may be for- 
mulated as the following fact relating the generic initial ideal of X to the 
generic initial ideal of a general hyperplane F. 

Fact 1. The saturation of gin(Ix\H) with respect to Xn-i is equal to gin{XY). 

Note that the transformation g\n{Zx\H) ^ gin(Xx|_f/)a;„_i induces a 
graphical transformation r(gin(2x|_f/)) ^ T{g\n{Ix\H)x„-i) given by itera- 
tively contracting all edges in the tree dominated by vertices that dominate 
Xn-i-labeled vertices, until no leaves labeled x^-i remain. On the other 
hand, the contractions taking T(gin(Tx j/f)) to r(gin(Tx|_f/)x„_i) may be 
viewed as transformations of trees of (minimal generators of) homogeneous 
ideals of C[xo, . . . ,Xn] that are inverse to certain rewriting rules, which we 
call C-rules and display in Table [21 Therefore, Fact ^ may be reformulated 
in the following useful way. 

The tree corresponding to any generic initial ideal defining a nondegen- 
erate subscheme X C o/ dimension 1 is obtained from the gin of a general 
hyperplane section of X by applying a sequence of C-rules. 
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Since hyperplane gins are generated by A-rules, we have proved the fol- 
lowing statement, which is essential for what follows and will be used here- 
after without comment. 

Every Borel-fixed monomial ideal associated to a curve C C may he 
represented by a tree obtained from the empty symbol by applying a certain 
sequence of A-rules, followed by a certain sequence of C -rules. 

Likewise, we will make use of the following result of Bayer-Stillman (see 
|Gre[ Thm. 2.27]): The regularity of any Borel-fixed homogeneous ideal I is 
equal to 

maxjdegP \ P is a minimal generator of gin(I)}. 

Here, as everywhere else in this paper, the underlying term order on mono- 
mials is assumed to be revlex; indeed the proposition fails to hold for arbi- 
trary term orders. 

The following lemma permits us to identify all Borel-fixed ideals associ- 
ated to general hyperplane sections of subschemes of P^. 

Lemma 1.2.2. The number of nonleaf vertices in the tree defining a zero- 
dimensional subscheme o/P'^ is equal to the scheme's degree. 

Proof. We proceed by induction on the degree of the subscheme F C P'^. 
Without loss of generality, we may assume T is nondegenerate, since the 
restriction Fl^, of F to its linear span L satisfies deg(F|2,) = deg(F). Thus, 
gin(/r) is a monomial ideal whose minimal generators are polynomials in 
xq,xi, and X2. Moreover, since F is zero-dimensional, gin(/r) has one min- 
imal generator of the form for some positive integer A. Furthermore, A 
is the maximal total degree of any minimal generator of gin(Ir). 

If deg(F) = 1, the claim is trivial, since the only nondegenerate zero- 
dimensional subscheme of P^ of degree one is the point, whose ideal (up to 
projective linear transformation) is (xo,xi,X2). If deg(F) > 1, then gin(/r) 
may be obtained from the gin of the point by applying finitely many F-rules, 
so by induction it suffices to check the following statement: 

Let F and F' be zero-dimensional subschemes o/P^ defined by Borel-fixed 
ideals I and I' 0/ C[xo, xi, X2, X3], respectively. If I' is obtained from I by 
applying a single A-rule to I, then deg(F') = deg(F) + 1. 

To check the latter claim, first note that by the regularity criterion |Gre| 
Thm. 2.27] of Bayer-Stillman cited above, the ideal sheaves X and I' asso- 
ciated to the two homogeneous ideals in question are A'-regular, where 

A' := max{ deg(P) | P is a minimal generator of /' }. 
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Therefore, there are exact sequences on global sections: 

^ H\l{\')) ^ /?°(Op3(A')) ^ F0(Or(A')) ^ 

and 

^ H\l'{\')) ^ F0(Op3(A')) ^ F0(Or,(A')) ^ 0. 

Moreover, since F and V are zero-dimensional, their degrees are equal to 
their Euler characteristics. Since I{\'),I'{X'), and O^si^X') have no higher 
cohomology, x = foi" each of these sheaves. 

Because x is additive across short exact sequences, it follows that 

X{T) = h^iO^X')) - H\T{X')) and xi^') = h^O^X')) - h^il'iX')). 

But clearly h^{Z'{X')) = h^{Z{X')) — 1, since /' is a saturated homogeneous 
ideal with one fewer monomial generator (not necessarily minimal!) in de- 
gree A' than /, which is also saturated and homogeneous. It follows imme- 
diately that x(r') = x(r) + 1, whence deg(r') = deg(r)+l. □ 

Example. Figure ^ shows the tree-representation of the hyperplane gin 
of a rational normal quartic in = Proj C[3;o, a^i, 2:2, 2:3, X4]. Note that in 
this example, 

gm{Ic) = gmilcnHf'K 

where H is any hyperplane generic with respect to C, and gm.{Icr\H)^'^^ 
denotes the extension of gin(2cn_ff) to C[xo, . . . , X4]. The A-rules are marked 
as Aj, for i = 1, . . . , 4. Exactly four vertices are not leaves. 
In this example the hyperplane gin is 

/ = (Xq, XqXi,XqX2, xl, XiX2,xl), 

the gin of four points in general position in F'^. These points arise as the 
generic hyperplane section of a rational normal quartic, so according to 
Fact n the gin of some rational normal quartic must be obtainable by the 
application of some nonnegative number m of A-rules from /. Indeed, one 
can check (using, e.g., the computer algebra system Macaulay2 of |GSj 'l that 
the gin of the rational normal quartic is {xq, xqXi, X0X2, xf, X1X2, X2); so in 
this case, m = 0. 

To construct the tree in the example, we may proceed as follows. First, 
apply the initial A-rule to obtain the ideal {xo,xi,X2)- Next, apply a 
rewriting rule at the vertex corresponding to the generator X2, replacing 
X2 with X2- The corresponding rule is X2 ^ • Similarly, replace xi 
with {xl,xiX2) via xi 1-^ {xf,xiX2) and replace xq with {xq, xqXi, X0X2) via 
xo ^ (xg,xoa:i,xoX2). 
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1.3 Hyperplane gins for nondegenerate curves 

In this subsection, / denotes a saturated Borel-fixed ideal defining the gin of 
some general hyperplane section of some (fixed) nondegenerate, irreducible 
degree-10 rational curve C. Throughout, we use Borel(J) to denote the 
smallest Borel-fixed ideal containing the ideal J. We shall see that the 
minimal generating set of I is subject to significant numerical restrictions, 
which together imply there are very few possibilities for /. Four out of the 
five corresponding possible trees, which we will implicitly refer to in the 
course of establishing bounds on /i^(Tc(5)), are given in figures 2 through 
5. 

To begin, note that every general hyperplane section F of C is (the 
reduced scheme associated to) a set of ten points in uniform position in 
a three-dimensional projective space. By a result of |Balj bounding the 
regularity of ideals of points in uniform position, Zy is 4-regular, so / is 
minimally generated in degrees at most 4. 

// / has no quadratic generators, then 

/ = Borel(2;^) 

('322 2 232 2 3\ 

= (Xq, 2^0-^1' ^0-^2) XqXi, XqXiX2, XQX2, X^, X1X2, X1X2, X2), 

by saturatedness, Borel-fixity, and Lemma ll.2.21 See Figured 
Similarly, if I has exactly one quadratic generator, then 

/ = Borel(xi3;2) + {xq,X2)- 

See Figure 01 

Next say that / has exactly two quadratic generators. Borel-fixity implies 
these are necessarily Xq and xqXi. Note that / ^ Borel(x2) + (3:0X1, Xq) since 
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Xq. 



1 



xi'- 



2 X2 



Xo" Xi '<X2 Xi IC2 X2 Xi X.2 X2 X2 
• ••••••••• 

Figure 2: Borel(x2) 




i 



Figure 3: Borel(3;i3;|) + (xo,xf) 



the corresponding tree has eight nonterminal vertices. Similarly, X1X2 cannot 
belong to /, since otherwise degree considerations force 

/ = Borel(xoa:i) + Borel {X1X2) + {x2)- 

The latter ideal is not 4-regular, and therefore violates the main result of 
|Balj ■ Therefore, if I has exactly two quadratic generators, then 

I = Borel(xoXi) + {xf,XiX2,xoX2) + (xiX2,x|). 

See Figure 13 

On the other hand,z// has exactly three quadratic generators, then these 
are either {xq,xoXi,xqX2} or {xq, xqXi, xf }, so degree considerations, satu- 
ratedness, and Borel-fixity force 

/ = Borel(xoa;2) + Borel(x2) + (x'^) or / = Borel(xoXi) + (xoX2 

14 




Xo 



1 ^3^2 



) / V 



X2 

0^2 3^2 
• • 

a^2 3^2 



Figure 4: Borel(xoXi) + (xf , j;^X2, xoXg) + (xiX2,X2 



See FigureElfor a presentation of / = Borel(xoXi) + (xoX2, xj, xiXg, 






Figure 5: Borel(xoXi) + (xox^, xf , xix^, x|) 



Note that no zero- dimensional, saturated, and nondegenerate Borel-fixed 
ideal / C C[xo, • • • , X3] of degree 10 having at least four quadratic generators 
is 4-i"egular. For, by Borel-fixity, if I has at least four quadratic generators 
then these necessarily include 

Xq, xqXi, X0X2, and x^, 

so that 

/ = (xq, xqXi, X0X2, xl) + (xix|) + (x{), 

for some e and /. Borel-fixity implies / > e, but then Lemma 11.2.21 implies 
e + / = 10, so / has minimal generators in degree 5 or higher. 
In sum, we have proved the following result. 
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Proposition 1.3.1. / has at most three quadratic generators, and is one of 
the five monomial ideals listed above. 

1.4 Computing h^{Ic{5)) from a tree of minimal generators 

In this subsection we prove a few technical lemmas that will be used, in the 
proof of Theorem 12.11 to obtain bounds on h^{Ic{^))- 

Lemma 1.4.1. Let C C P'* denote any nondegenerate degree-W integral 
curve. Then h^{Oc{5)) = 0. 

Proof. The Castelnuovo-Halphen genus bound (see, e.g., [03 (l-l))P-27]) 
implies g{C) < 9, whence deg{Kc) = 2g{C) — 2 < 16. Since C is inte- 
gral (and in particular Cohen-Macaulay) , Grothendieck duality (see |AK) ) 
implies 

h'{Oc{5)) = h^{Kci-5)), 

where Kc denotes the dualizing sheaf C. It therefore suffices to show that 
Kc{—5) has no global sections. 

Suppose Kc{—5) has a section. Then there is an injection 

O^Oc^ Kci-5), 

or equivalently, an injection of invertible sheaves 

^ Oc{5) ^ Kc. (1.1) 

In particular, we have 

x{Kc) = x{Oc{5))+x{Q), 

where Q denotes the quotient of (jLlf) . Since ()1.1() is generically an iso- 
morphism, Q is supported at finitely many points, so x{Q) = f^^{Q) is 
nonnegative, and therefore 

x{Kc) > x{Oc{5)). (1.2) 

The right side of (|1.2|) equals 5x10 — 5(C)-|-1 and is therefore at least 42, 
whereas the left equals 2g{C) — 2 — g{C) + 1 and is therefore at most 8. So 
h^(Kc{—5)) = after all, and the lemma is proved. □ 

As explained in Section [l.H it follows that 

/i°(Xc(5)) = 126 - {5 X 10 - g + 1) + i. (1.3) 
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On the other hand, Xc and gin Xq have the same regularity, so since 

/i2(Tc(5))=/ii(Oc(5)) = 0, 

we also have /i^(gin Tc(5)) = 0. So in fact H1.3() remains true when Xq is 
replaced by gin(2'c). 

Lemma 1.4.2. Let I C C[xo, • • • , 2:4] he a Borel-fixed monomial ideal of 
dimension 1, and I' the ideal obtained from I by applying a single C-rule. 
Theng{I')=g{I)-l. 

(Recall from the introduction that g{I) and g{I') denote the genera of 
the subschemes of defined by / and /'.) 

Proof. Let X and X' denote the sheaves associated to I and and let C 
and C denote the corresponding subschemes of P^. Let m be any positive 
integer for which all four sheaves are (m — l)-regular. Then h^(X{m)) = 
h^{X'{m)) = 0, so there are exact sequences of sections 

^ H^{X{m)) H°{Op4{m)) H^{Oc{m)) 

and 

^ H^{X'{m)) H^{0^i{m)) H^{Oc'{m)) 0, 
Moreover, since h^{Oc{'m)) = h^{Oc>{m)) = 0, we have 



m 



and 



\ m J 

by the Riemann-Roch formula. On the other hand, X and X' are both 
saturated, so h^{X{m)) and hP{X'{m)) are exactly the numbers of linearly 
independent monomials in the homogeneous ideals / and /', respectively, of 
total degree at most m. Hence 

h^{X'{m))=h^{X{m))-l. 

The lemma now follows immediately from equations (|1.4j) and (|1.5|) . □ 

Now let C C P'^ be a nondegenerate degree-10 integral curve, and set 



I :- 



h^Xcib)). 
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Lemma 1.4.3. The number of vertices in the tree representing ginZci^) 
dominating vertices of degree greater than 6 (equivalently, the number of 
rewritings applied to vertices of degree 6 or greater) equals i. 

Proof. Let v denote the number of rewritings applied to vertices of degree 
6 or greater. Recall f Prel Thm. 2.27]) that any generic initial ideal / for 
the reverse-lexicographic order is m-regular if and only if it is minimally 
generated in degrees m or less. So if = 0, then C is 6-regular, and therefore 
i = = f . Now say u > 0. By Lemma 11.4.21 each successive C-rewriting 
Tj : T(/j) T{Ii^i) satisfies 

g{Ci+i) = g{Ci) - I, 

where Cj and Cj+i denote the subschemes of defined by /j and /j+i, 
respectively. Now let deg(rj) denote the degree of the vertex of T(/j) at 
which the rewriting rj is applied. Note that if deg(rj) > 6, then the number 
of linearly independent quintic polynomials in /j+i equals the corresponding 
number in /j. So, because rewritings preserve saturatedness, 

By (jLcSj) . it follows that if > 6, then 

The lemma follows immediately by induction on v. □ 

Note that by Lemma 11.4.21 i also measures the failure of C to impose 
linear independent conditions on quintic hypersurfaces. 

1.5 Nondegenerate curve gins associated to hyperplane gins 

In this subsection, we obtain restrictions on minimal generating sets of 
generic initial ideals of irreducible, nondegenerate rational curves of degree 
10 in P^. To see how this is possible, fix a choice C of such a curve, with F 
a hyperplane section of C defined by 

r:=cnH, 

where H is a general linear form. Make a general choice of coordinates 
xq, . . . ,X4 on P^ with respect to which H is defined by = 0. Let / := 
gin(Tr). Then by Fact^ gin Iq' is obtained via a sequence of C-rewriting 
rules from the extension of / C C[xo, • • • , X3], to C[xo, . . . , X4]. 
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As usual, let i := h^{Ici5)). The result of [HLPI Thm. 3.1, p. 501] 
implies that the ideal sheaf 2c is 7-regular unless C admits an 8-secant 
line (here points along the line are counted with multiplicity). So most of 
the time, |Grel Thm. 2.27] implies that gin Ic is minimally generated by 
polynomials of degree at most 7. This fact limits the number of C-rewritings 
that occur in degrees at least 6 used to obtain gin Iq from /, which in turn 
measures i, according to Lemma ll.4.31 

Let Cr denote the cone with vertex (0, 0, 0, 0, 1) over the zero-dimensional 
scheme defined by the vanishing of / in H. Thus Cr is one-dimensional, and 
its minimal generators are exactly those of /; that is, Icj. is the extension 
of / to C[a;o, . . . , 2:4]. Let gr := g{Cr)- In the proof of Theorem 12.11 we will 
repeatedly use the following two technical results. 

Lemma 1.5.1. gr—g is the number of C-rewritings applied to yield gin[Ic) 
from I, and g + i < gr- 

Proof. The first statement is an immediate consequence of Lemma 11.4.21 
The second statement therefore follows immediately whenever i = 0. Note 
that gin Ic may be obtained in two steps: 

1. Perform a number ri of rewritings in degrees less than six. 

2. Perform a number r2 of rewritings in degrees six or greater. 

Let C denote the scheme defined by the ideal that is the outcome of step 1. 
Clearly, we have 

gr - g{C) = ri 

and 

5(C) - g = r2. 

But Lemma ll. 4. 31 implies that 

i = r2, 

so the second statement of the Lemma follows immediately. □ 

Now, let m be any positive integer such that C is m-regular. 
Lemma 1.5.2. gr = 10m + 1 - + /i°(2:crM)- 

Proof. Because Cr is m-regular, the long exact sequence in cohomology 
associated to 

^ Icrim) ^ Op4(m) ^ Ocr(m) ^ 
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shows that Oc^ is m-regular, too. Therefore, there is an exact sequence 

^ HyicAm)) ^ i?°(Op4(m)) ^ ^^(OcrM) ^ 0, 
and h^{Ocr{m)) = 0. It follows that 

/i°(OcrM) = 10xm-5r + l, (1-6) 

and also 

h'iOcAm)) = + -/.°(Tc,(m)). (1.7) 
To conclude, simply compare H1.6() and (jl.Tf) . □ 

2 Irreducible rational curves of degree 10 in 

In this section, we'll prove the following theorem, which extends to degree 
10 an earlier result f |JKll Thm.3.1]) of Johnsen and Kleiman's. 

Theorem 2.1. The incidence scheme of smooth rational curves of degree 
d at most 10 on quintic hypersurfaces F cf^ is irreducible. Moreover, any 
smooth curve C lying on a general quintic F is embedded with normal bundle 
Oci—l)(BOc{—l)- Furthermore, there are no rational and singular, reduced, 
and irreducible curves of degree at most 10 lying on a general quintic in P^, 
other than the six-nodal plane quintics. 

As noted in the introduction, there is an interesting corollary with sig- 
nificance for mirror symmetry. 

Corollary 2.1. The instanton number uiq for a general quintic threefold F 
does not equal the number of smooth rational curves of degree 10 that lie on 
F. 

To prove the theorem, we'll borrow extensively from Johnsen and Klei- 
man's work; they prove the theorem in degree at most 9. 

2.1 Initial reductions 

Let denote the affine space of parameterized mappings of into P"^ 

that map birationally onto images of degree 10, of arithmetic genus g, and 
of span an r-dimensional projective space. Note that we do not mod out 
by the PGL(2)-action on P^; nor do we projectivize. Let I^q denote the 
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incidence locus in M[q^ x P^^^. Let M^q- C M[q^ denote the sublocus of 
morphisms with images C satisfying 

h\lc(.5)) = i, 

and let I^'^- C /[jf denote the pullback of M^^- under the canonical projec- 
tion Il'o^ ^ Pl25. 

As explained in [JK1|, to prove Theorem 12.11 it's enough to show that 
the projection /[q' — > P^^^ is surjective only over the irreducible component 
-^10,0 of morphisms whose images C are smooth with /i^(Tc(5)) = 0. In 
particular, this statement implies the finiteness of the Hilbert scheme of 
curves on a general quintic, and the splitting property of the normal bundles 
Mc/F follows immediately from Verdier's result |Vel Thm, p. 139]. See the 
proof of jJKl, Cor 2.5] for more details. 

However, since the projection's fibres all have dimension at least 4, to 
prove that it's not surjective over the locus of curves with i nonzero, it 
suffices to establish that dim/[Q^ < 129. Using the exact sequence 

^ /?°(Xc(5)) ^ ^°(Op4(5)) ^ H'{Oc{5)) ^ H\Ic{5)) ^ 0, 

to relate the Hilbert polynomial of 2c to that of C, we see that 

dim/[^». < dimM[^^. + 126 - (5 • 10 - 5 + 1) + i, 

at least provided H^{Oci5)) = 0. (See |JKT1 for more details.) Assuming 
this vanishing, which we prove in Lemma 11.4.11 below, we are reduced to 
showing that 

dimM[5^. < 55-C/-Z (2.1) 

whenever i is nonzero. 

In order to simplify the notation, we let i := h^(Ic{5)) hereafter. 

We may also assume r > 3, since (as noted in |,TKH Section 3]) no planar 
rational curves of degree greater than 5 lie on a general quintic. 

Moreover, by the result of |,TKH Lemma 3.4], we have 

dimM^'^ < 5((i + 1) - 1 - min(25, 8) for all d>7, and (2.2a) 
dimMj'^ < 4((i + 1) - 1 - mm{g, 5) for all d>9. (2.2b) 

To establish the validity of (|2.H) . we treat nondegenerate curves and 
curves with 3-planar images separately. It's interesting to note that in this 
paper, unlike in |JK1 , the main technical work lies in the proof of (|2.1j) in 
the nondegenerate case. Accordingly, we first consider nondegenerate curves 
in P^. Applying 1)2. 2a() . it's easy to see that Theorem 12. II for nondegenerate 
curves amounts to the following. 
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Theorem 2.2. The nondegenerate reduced irreducible rational curves veri- 
fying 

g + i > min(2(7, 8) 

define a sublocus of the parameter space Miq of degree-10 rational maps of 
codimension greater than g + i. 

2.2 Special subloci of the mapping space 

In this subsection, we obtain lower bounds on the codimensions of certain 
special subloci of Miq. These estimates effectively allow us to ignore certain 
curves C corresponding to generic initial ideals with large /i^(Xc(5)). 

Lemma 2.2.1. Degree-10 morphisms determining nondegenerate degree-10 
rational curves with 8-secant lines have codimension at least 10 in the space 
of rational mappings of degree 10. 

Proof. Every rational map /: ^ of degree 10 is parametrized by 5 
equations re, = fi{t,u) for i = 0, . . . , 4, where {t,u) are coordinates on P^, 
the coordinates on P^, and fi is a polynomial of degree 10 in t and 

u. To say that the image of / intersects the line L = {xq = xi = X2 = 0} in 
distinct points f{tj,Uj) for 1 < j < 8, means precisely that 

fi{tj,Uj) = for < i < 2 and 1 < i < 8. (2.3) 

In other words, 24 linearly independent equations must be satisfied. So 
requiring a map / of degree 10 to map any fixed degree-8 divisor onto distinct 
points along any fixed line L is a codimension-24 condition. Moreover, if we 
allow the image points to coalesce and replace the equations 1)2. 3|) by their 
higher-contact analogues, then the same argument shows that requiring / 
of degree 10 to map any fixed degree-8 divisor along any fixed line L is a 
codimension-24 condition. On the other hand, the degree-8 divisors on P^ 
determine a P^ and the Grassmannian of lines in P^ has dimension 6, so 
by varying our choice of eight points in P^ along with the choice of the line 
L C P^, we obtain 10 conditions and the result follows. □ 

Lemma 2.2.2. Degree-10 morphisms defining rational curves in reduced, 
irreducible hyperquadrics determine a locus of codimension at least 7 in Miq. 

Proof. By the main result of |KiPaj . the space of rational curves of any 
fixed degree d inside a projective homogeneous space is irreducible and of 
the expected dimension. On the other hand, every smooth hyperquadric is 
a homogeneous space, and any two hyperquadrics are isomorphic, so the 
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codimension of curves lying on smooth hyperquadrics is the expected one. 
Note that hyperquadrics F C comprise a P^^ and that the equation 
defining the incidence scheme {C C F : C e Mio,F G P^^ in Mio x P^^} 
is a polynomial in the coordinates of P^ in 21 parameters. So 21 linearly 
independent conditions must be met for a degree-10 curve to lie on a fixed 
smooth hyperquadric. By varying the choice of hyperquadric, we find that 
the codimension of (morphisms corresponding to) curves inside smooth hy- 
perquadrics is 7. 

Now let Q be a singular, reduced, and irreducible hyperquadric. Since 
it contains a nondegenerate curve C, it must be a cone over a quadric Q of 
rank 2 or 3. 

Say rank((5) = 3. Let Homio(P^,y) denote the (affine) parameter space 
of morphisms ¥^ ^ Y. When Y = F^, a morphism / : P^ ^ y is given by 5 
sections fi S H^{Ofi (deg(/))) for i = 0, . . . , 4. Projection from the vertex of 
Q defines a rational map vr : Homio(P\P^) ^ Homio(P\P^). Now assume 
that the vertex p oi Q has coordinates (0, 0, 0, 0, 1). Then vr : Homio(P^, P^) 
is the rational map that drops the fifth parameterizing polynomial: 

ifo, fl, f2, fs, h) ^ ifo, fl,f2, /s)- 

Since /4 has 11 coefficients, the (affine) fibre dimension of vr is 11 over 
any degree-10 map / whose image curve avoids p. Any such map / € 

Homio(P\ Q) is sent under vr to a map f£ Homio(P\ Q), where Q= P^ x P^ 
is a smooth quadric surface. As explained in |JKll Lemma 3.2], the scheme 

associated to Homio(P^,Q) is a disjoint union of 23-dimensional projective 
spaces. 

On the other hand, quadric cones determine a divisor inside the P^^ of 
hyperquadrics in P^. Since rational maps whose images pass through the 
vertex of Q clearly comprise a proper closed subset of Homio(P^, Q), we 
conclude that rational maps to cones over quadric surfaces vary in a family 
of dimension at most 13 + 11 + 23 = 47. In other words, such maps determine 
a locus of codimension 55 — 47 = 8 inside M^q. 

To complete the proof of Lemma 12.2.21 we must handle rational curves 
whose images lie in cones Q' with 1-dimensional vertices over plane conies. In 
fact, these pose no problem. For, by a result of |(Tuj quoted in |,TK1[ proof of 
Lemma 3.2], Homio(P^, Q') is at most 23-dimensional. We now conclude by 
applying the same projection-based argument used in the preceding case. □ 
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2.3 A useful stratification of the mapping space 

Let /: — > be a map with image C. Note that the (— l)-twist of the 
"restricted tangent bundle" f*Tpi{—l), has degree 10 and rank 4 over P^, 
say with sphtting 

4 

rTp4(-l) =00pi(a,). 

i=l 

A result of Verdier's (see |Vej and |Raj ) establishes that the scheme of mor- 
phisms P^ —>■ P^ of fixed degree corresponding to a particular splitting type 
(ai, a2, 03, 04) with oi > 02 > 03 > 04 is irreducible of the expected codi- 
mension 

max{0, a, — aj — 1}. 

In particular, every special splitting stratum has codimension 4 or more, 
and the stratum (4, 3, 2, 1) is the unique stratum of codimension 4. If 
f*Tpi{-l) has the generic splitting, then /\^(/*rp4(-l))* C'pi(5) has no 
higher cohomology, and it follows by |GLP1 Proposition 1.2] that Ic is 6- 
regular. So i 7^ in codimension 4. Therefore, in light of the discussion 
immediately preceding the statement of Theorem 12.21 we have reduced to 
showing that for all nondegenerate C such that i ^ 0, one of following 
conditions is verified: 

g + i <4, or (2.4a) 

C admits an 8-secant line and g + i < 10, or (2-4b) 

C lies on a hyperquadric and g + i < 7, or (2-4c) 

g + i <mm{2g,8). (2.4d) 

A curve C meeting any of these conditions will be called nonproblematic. 
Similarly, any sublocus of Miq comprised of nonproblematic curves will be 
called nonproblematic. 

2.4 Proof of Theorem 12.11 for nondegenerate curves 

To prove Theorem 12. 11 we obtain bounds on h^{Zc{5)), based upon an anal- 
ysis of possible corresponding Borel-fixed monomial ideals. Each gin(Tc) is 
obtained, by Fact 1, by applying a sequence of rewriting rules to gin(2rr)- 
We now argue case by case, based upon the possibilities for gin(2'r). 

Case 1. Say gin{2r) = Borel{x\). 
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Because /cp is minimally generated by polynomials of degree at most 3, 
Cr is 3-regular. So Lemma 11.5.21 implies that 




(Jc,(3))-4. 



But, because Ic^ is saturated, /i*'(Xcp(3)) is equal to the number of linearly 
independent polynomials of degree 3 in I^p. Since there are exactly ten of 
these, we find gr = 6. 

It follows from Lemma 11.5.11 that g + i < 6. Note that if C as above 
admits an 8-secant line, then C belongs to a locally-closed subscheme inside 
Mio of codimension at least 10, by Lemma [2.2.11 Thus C is nonproblematic. 
The remaining curves are 7-regular, by |GLPl Thm. 3.1, p. 501]; we will see 
that they, too, are nonproblematic. For this purpose, we begin by showing 
that each one satisfies 



By Lemma ll.5.1l gm{Tc) may be obtained from Iqy by applying precisely 
6 — g rewriting rules. On the other hand, by Lemma 11.4.31 i is exactly 
the number of C-rewritings applied in degrees 6 or greater. In particular, i 
is maximized when the number of C-rewritings (of arbitrary degrees) is 
maximized, which happens when g = 0. Therefore, for the purpose of 
verifying 1)2. 5() . we assume g = 0- 

There are now a large number of possible C-rewriting sequences to choose 
from. For the sake of bounding i, however, we only need consider those 
rewriting sequences that result in the maximal number of minimal generators 
of degree greater than six. Moreover, certain rewritings are dictated by 
Borel-fixity. If i is nonzero, for instance, then the minimal generator 
must be rewritten. Without loss of generality, therefore, we assume the first 
rewriting rule exchanges the minimal generator X2 for minimal generators 
X2 and X2X3, i.e., that it is X2 1— > {x2,X3) applied at the leaf corresponding 
to the minimal generator of gin Ir- 

Similarly, we may assume the next three rewriting rules have the effect 
of exchanging the minimal generator X2X3 for xfxl. But then no further 
rewriting may be applied to X2X3, since C is 7-regular. So rewriting twice 
more, beginning with minimal generators of degree at most 4, results in 
minimal generators of degree at most 6; for instance, we might have 



The latter ideal is obtained from the (extension of the) hyperplane gin by 
applying C-rules to leaves that are "farthest to the right" in the tree of 
Figure 2; see Figure IHl It follows immediately by Lemma 11.4.31 that i <1. 



i < 1. 



(2.5) 



gin(Xc') = Borel(xiX2) + (xg, X2X3, X2X3). 
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Figure 6: gin Iq = Bore^xixl) + (x2, xfx^, x^xl). The C-rules are marked 
as Ci, i = 1, . . . , 6. 

It follows that 

5 + i < 4 

whenever g <2. Therefore, ii g <2, then C is nonproblematic. 

It remains to show that 7-regular C with g > 3 and g + i < 6 are 
nonproblematic. By Lemma 11.5.11 every such C is such that gm(Ic) is 
obtained from the hyperplane gin by applying at most 3-rewriting rules, all 
of which are necessarily in degrees less than six. By Lemma 11.4.31 it follows 
that i = 0. So every such C is indeed nonproblematic. 

Case 2. Say gin Zy = Borel{xiX2) + (xq,^!). 

Because Icp is minimally generated by polynomials of degree at most 4, 
Cr is 4-regular. So Lemma 11.5.21 implies that 

5r = /i°(Xcr(4))-29. 

Because Icr is saturated, /i'^(Xcp(4)) is equal to the number of linearly 
independent polynomials of degree 4 in Ic^ ; there are 36 of these, so = 7. 
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It follows from Lemma 11.5.11 that g + i < 7. It follows, as in Case^ that 
if C admits an 8-secant line, then C is nonproblematic. The remaining 
curves are 7-regular, by |GLPl Thm. 3.1, p. 501]; we now show they are also 
nonproblematic. 

By Lemma 11.4.31 i is exactly the number of C-rewritings applied in 
degrees 6 or greater. But by Lemma 11.5.11 gm{Zc) may be obtained from 
Icy- by applying precisely 7 — g rewriting rules. But because C is 7-regular, 
it follows there are no rewritings in degree greater than 6. Moreover, there 
are at most three rewritings in degree 6, because it takes six rewritings total 
to obtain three rewritings in degree 6, and any seventh rewriting will be in 
degree less than 6. (Compare Figure 3.) Therefore, i < 3. 

It follows immediately that g = 0, then g + i < 3 and, therefore, C is 
nonproblematic. 

Similarly, if g = 1, then either g + i < 3, in which case C is nonproblem- 
atic, oi g + i = 4 and gin(Xc') corresponds to the tree of Figure □ In the 
latter situation, however. Figure 7 shows that C lies on a hyperquadric, and 
therefore, by Lemma 12.2.21 C is nonproblematic. 

Similarly, if 5^ = 2, then gin(Xc) is obtained from the hyperplane gin in 5 
rewritings, of which at most 2 may be in degree 6. So i < 2 by Lemma ll.4.31 
i.e., 5 + i < 4. Moreover, equality is obtained if and only if C lies on a 
hyperquadric, in which case C is nonproblematic, by Lemma 12.2.21 

Finally, if g > 3, then gin(2c) is obtained from the hyperplane gin in 
at most 4 rewritings, so i < 2, which implies g + i < min(2(/,8). So C is 
nonproblematic in this situation as well, which enables us to conclude. 

Case 3. Say gin Ir = Borel {x^xi) + {x\,x\x2.,xqx^) + (xixl,^!). 

To show that the corresponding curves C are nonproblematic, we proceed 
as follows. 

First, C is 4-regular, so 

gv = h\lcY{A))-29, 

by Lemma ll. 5. 21 Since Iqy contains 37 linearly independent polynomials in 
degree 4, we have = 8. Hence, 5 + i < 8, by Lemma 11.5.11 Note that 
applying r < 2 C-rewriting rules to results in a Borel-fixed ideal that is 
minimally generated in degrees at most 6 and has genus gr — r, by Lemma 
11.4.21 So if (7 = 6 or 3 = 7, then gin Ic is 6-regular, by |Grel Thm. 2.27], 
and moreover 

g + i < min(25,8), 
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Figure 7: gin Tc = {x^) + Borel(a;iX2) + (xg, 3:2^3, X2X3, x^xl). The C-rules 
are marked as Cj,i = 1, ... ,6. Clearly, 5 = 1. Moreover, i = 3, since there 
are exactly three C-rules in degree 6. 



and therefore C is 6-regular. We now show curves of genus 8 are nonprob- 
lematic, too. 

Note that any such curve C with g = 8 necessarily satisfies 

ginCXc) = Icr > 

by Lemma ll. 5. II Since h^{Xcr{'^)) — 2, it follows that C lies on two linearly 
independent hyperquadrics Qi and Q2- These intersect in a surface S of 
degree 4. In fact, C is also contained in a hypercubic, K, that is linearly 
independent of Qi and Q2- To see why, assume that no such K exists. Then 
every hypercubic K containing C satisfies Qi n Q2 C K, so we must have 

h\lcm<h\lQ,nQ,{3)), 

and therefore 

/i°(Tr(3)) < /i°(Xa(3)), (2.6) 
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where T and A denote general hyperplane sections of C and Qir)Q2, respec- 
tively. Note that Qi and Q2 are nondegenerate, since they contain C; so 
Qi nQ2 is a nondegenerate quartic surface, and A is a nondegenerate quartic 
space curve. By |GLP1 Thm. 3.1, p. 501], A is 3-regular, and it follows from 
the usual long exact sequence in cohomology that 0\ is 3-regular, too. So 
there is an exact sequence 

^ //°(Xa(3)) ^ F0(Op3(3)) ^ i?°(OA(3)) ^ 0, 

and by the Riemann-Roch theorem, we deduce that 

/i°(Oa(3)) = 13-5(A). 

By |(]i) . A has genus at most 1; it follows that 

/i°(Xa(3)) < 8. 

On the other hand, we have 

/iO(Tr(3)) = 10, 

so H'2.6p is violated, which gives a contradiction. 

Now let S := QiCi Q2- li S H K contains a surface component S*, then 
clearly S* is properly contained in S, whence deg(5*) < 4. Note that C lies 
on either S* or on a component S** belonging to the residual to S* in QiriQ2- 
However, because C is nondegenerate, C lies on no component of S degree 1 
or 2. So the component of S on which C lies is a nondegenerate threefold of 
degree 3, which is necessarily a cubic scroll by |GHl Prop., p. 525]. Moreover, 
no cubic scroll containing C meets K properly, since deg(C) = 10. So S** is 
a surface component oi S f] K. Therefore, replacing S* by S** if necessary, 
we may assume S* is a cubic scroll containing C. 

We handle degree- 10 curves on cubic scrolls in as follows. As explained 
in |GH1 pp. 519-523], cubic scrolls come in two basic types. Another good 
reference for scrolls, whose notation we will use and to which we will often 
refer, is |Coj . Those that are smooth will be denoted Si^2 (in the notation 
of [(irHj . these are the scrolls ^i^i). Those that are singular are cones over 
twisted cubic curves, and will be denoted by 5o,3. 

Every Si^2 may be realized as the image of the Hirzebruch surface Fi := 
P(Opi © (9pi(l)) under the map ^1^2 defined by the complete linear series 
\OFiie + 2/)], where e is the divisor class of the — 1-curve on Fi and 
/ is the class of the fibre. 
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The intersection pairing on Fi is given by 

e2 = -l,e-/ = l,/2 = 0. 
Moreover, the canonical class of Fi is 

Kf, = -2e - 3/. 

Let (pi 2[C] = ae + bf G Pic Fi. The adjunction formula implies that the 
arithmetic genus of C satisfies 

25 - 2 = ((a - 2)e + (6 - 3)/) • (ae + 6/), (2.7) 

i.e., 

-2ab + a + 2b + 2g -2 = 0. (2.8) 
Also, since deg(C) = 10, we have 

(e + 2/) • (ae + bf) = 10, 

or equivalently, 

6 = 10 -a. (2.9) 
Substituting ((T^ in ((TH)) . we obtain 

30^-210 + 18 + 25 = 0. (2.10) 

If (7 = 8, then ()2.10|) has no integral solutions o. 

Finally, we treat curves C lying on cones So, 3 over twisted cubics. Every 
5*0,3 is the image of the Hirzebruch surface F3 = P(Opi © Opi(3)) under the 
map 4>o,3 defined by the complete linear series \OF3ie + 3/)|, where e is the 
divisor class of the of — 3-curve on F3 and / is the class of the fibre. Note 
that 00,3 is a birational map that blows down the —3-curve to the vertex of 

'S'o,3- 

The intersection pairing on F3 is given by 

e2 = -3,e-/ = l,/2 = 0. 
The canonical class of F3 is 

Kp; = -2e - 5/. (2.11) 

Now say that C avoids the vertex p of 80^3. Then [(/>o 3C] = oe + bf, for 
some integers o and b. In fact, since deg(C) = 10, we have 

(e + 3/) • (oe + bf ) = 10, 
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whence, 

6 = 10. (2.12) 
On the other hand, the adjunction formula then imphes that 

2<7 - 2 = ((a - 2)e + (6 - 5)/) • (ae + bf). (2.13) 

Substituting 6 = 10 in (|2.13() and solving for a yields 

a = ^g + l. (2.14) 



Here 5 = 8; by (|2.14j) . it follows a is not an integer, which is plainly absurd. 

Now say that C passes through the vertex of 5*0, 3 with multiplicity m > 0. 
Then [(l)olC] = ae + bf, for some integer b, and 

[C] = (a - m)e + bf, 

where C denotes the proper transform of C on F3. 
Let 9:= g{C)- Then we have 

2 5 -2 = ((a - m - 2)e + (6 - 5)/) ■ ((a - m)e + bf) (2.15) 
by the adjunction formula, 

g< g, (2.16) 

and 

(e + 3/) • (ae + bf) = 10, 
since deg(C) = 10. The latter equation implies 

b = 10, 

just as before. 

Substituting 6 = 10 in H2.15() and solving for a — m yields 

a-m = ^9+l, (2.17) 

for some g< 8. Because a and m are integers it follows from ()2.17|) that 

9= 7 and a — m = 3. 
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In particular, the genus discrepancy g— 9 is equal to 1; whence, 

m < 2, 

by the result of Rosenlicht quoted in |AK1 Ch. VIII, Prop. 1.16]. Therefore, 
there are two possibilities for the class of [(/if^gC]: either 

[cj^-^C] = 4e + 10/, 

or 

[<t)^lC] = 5e + 10/. 

To handle curves of the latter two types, we argue as follows. Since F3 
is rational, we have xIOfs) = 1- Therefore, the Riemann-Roch theorem for 
surfaces implies that 

Xiae + hf) = l + i((ae + bff - {ae + bf) ■ (-2e - 5/)). 
3 

= --a^ + ah - a + 2b + I. 

Substituting (o, b) = (4, 10) and (a, b) = (5, 10) yields 

X{ae + bf) = 33 

and 

X{ae + bf) = y, 

respectively. However, x(oe + bf) is necessarily an integer, so we must have 

(a, 6) = (4, 10). 

Then (|2.17j) implies that the proper transform of C on F3 has class 

[C]=e + 10/. 

However, the Riemann-Roch formula then implies that x{C) is not an inte- 
ger, which is absurd. 

Now consider the only remaining possibility, that S n -fC is a complete 
intersection X of type (2,2,3). Thus C is residual in X to a 1-dimensional 
scheme R of degree 2. Let C denote the linear series of hypercubics contain- 
ing C. By Bertini's theorem, a general member of C is smooth away from 
Sing(C) UBs(jC), where Bs(>C) denotes the base locus of C Assuming, as we 
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may, that the quadrics and cubics defining X are general among quadrics 
and cubics containing C, it fohows that R is reduced (i.e., a plane conic), 
since otherwise 

X C Bs(/:), 

which is absurd. On the other hand, the adjunction formula implies that 

Kx=Ox{2) and5(X) = 13, 

So g{R) = 16, by the main result of [N], which is also absurd. 

It follows that every curve C of genus 8 is nonproblematic. 

Next, say 5 = 6 or 7. Then gin(Xc) is obtained from the hyperplane gin 
in at most two rewritings, by Lemma 11.5.11 Because the hyperplane gin is 
4-regular, gin(Zc'), and therefore C, is 6-regular. Therefore, i = 0. It follows 
immediately from (|2.2a)) that C is nonproblematic. 

Finally, assume g < 5. Any C with g < 5 that admits an 8-secant line 
is nonproblematic, by Lemma l2.2.H and the remaining curves are 7-regular, 
by |(tLP| Thm. 3.1, p. 501]. From Figure 7 it's clear that any sequence of 
at most eight C-rewriting rules applied to the hyperplane gin that results 
in a 7-regular ideal involves at most 3 rewritings in degree 6. Therefore, 
by Lemma 11.4.31 i < 3. It follows immediately that if 5 > 4, then g + i < 
min{25f,8}, and therefore such curves are nonproblematic. 

Now say g < 3. Since curves on hyper quadrics have codimension 7 in 
Mio, by Lemma 12.2.21 we may and therefore shall assume that gin Iq has 
no quadratic generators. Since gin has two quadratic generators, the 
rewriting sequence that yields gin(Xc) from the hyperplane gin necessar- 
ily involves two rewritings in degree 2. So the generic initial ideal of C is 
obtained from the hyperplane gin via a sequence of rewritings involving at 
most one rewriting in degree at least six. Therefore, z < 1, by Lemma ll.4.31 
It follows that all curves of genus higher than 1 are nonproblematic. Simi- 
larly, if gf = 1 then g + i < 4 so C is nonproblematic. Finally, smooth curves 
are nonproblematic because i < 1 and i 7^ in codimension 4. 

Case 4. Say gin I-p admits exactly three quadratic minimal generators. 

Then either 

gin Zy = Borel(xoX2) + Borel(x|) + {x\) 

or 

gin Zy = Borel(xoXi) + {xqx\, x\, xix\,x\). 
By Lemma fl.5.21 (/r = 9 in either case. Therefore, g+i < 9, by Lemma fl.5.11 
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The proof that the corresponding locus of morphisms is nonproblematic 
fohows the same Hnes as in Case |31 above, so we merely sketch it. We may 
and shall assume C is 8-regular. Otherwise by |GLPl Thm. 3.1, p. 501], C 
has an 8-secant line; therefore, C belongs to a proper sublocus of Miq of 
codimension at least 10, by Lemma Ti. 2. II As ^i + i < 10, the latter sublocus 
is nonproblematic. 

Next we show that the locus of morphisms corresponding to C with 
g < 7 is nonproblematic. Since we are assuming C to be 7-regular, and since 
gin(Tc is obtained from the hyperplane gin in at most gr rewritings, it's not 
hard to see that at most 5 rewritings occur in degree 6, and therefore i < 5, 
by Lemma 11.4.31 Moreover, our upper bound on i improves to i < 3 if we 
also assume gin(Xc) has no quadratic minimal generators. If the assumption 
fails, then the morphism defining C lies in a proper sublocus of codimension 
7, by Lemma 12.2.21 but in such a situation C is nonproblematic. So our 
second assumption is justified, and we shall make it. The remainder of the 
argument when g < 7 is completely analogous to the one given in Case |31 
above. 

Finally, say g = 8 or 9. The liaison argument given in Case |31 implies 
that C necessarily lies on a (possibly singular) cubic scroll. Since rational 
degree- 10 curves of genus 8 on cubic scrolls do not exist, as shown by the 
analysis of Case |21 above, we may assume g = 9. Then C is a Castelnuovo 
curve in the sense of [211 P-27] and |(tH| p. 527]; namely, C is of maximal 
genus among nondegenerate, irreducible and nondegenerate curves of degree 
10 in P''. 

Say that C lies on a cubic scroll of type S'i,2- The adjunction formula 
implies that (|2.7j) holds, with g = 9. Solving, we obtain a = 3 or a = 4, 
which correspond to the classes 3a + 7/ and 4a + 6/, respectively. We next 
compute h^{0^^{ae + bf) for the pairs (3,7) and (4,6), respectively. 

Note that the dimension of the space of cubic scrolls Si^i C equals 
h^{Ojr^ (e + /)) — 1, while the dimension of the space of curves of class ae + hf 
on a given scroll equals h^{Osi i^^ + ^/)) ~ 1- 

Using the Riemann-Roch formula for surfaces, together with the inter- 
section pairing, we deduce 

x(OFi(e + /)) = 4, 
x(OFi(3e + 7/)) = 23, and 
x(OFi(4e + 6/)) =40. 

Moreover, a straightforward cohomological calculation (see |('o| Section 
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2]) shows that 

h'{Of,{ae + bf)) = 0,i = l,2, 

when {a,b) = (1,1), (3, 7), or (4,6). 

If follows that Castelnuovo curves of degree 10 on cubic scrolls of type 
5i^2 in IP^ determine a locally closed sub locus of Miq of dimension at most 
44. On the other hand, each Castelnuovo curve under our consideration 
satisfies i = 0, because each admits a 6-regular generic initial ideal gm{Zc)- 
Therefore, because 

55 - 44 > g, 

we deduce immediately that the sublocus of Miq corresponding to Casteln- 
uovo curves on scrolls 51^2 is nonproblematic. 

Finally, say that C lies on a cubic scroll of type 5*0,3 • Note that C cannot 
pass through the vertex of 5*0,3. To see why, note that adjunction applied 

to the proper transform C of C in F3 yields 

9= 7 and a — m = 3, 

just as in Case|31 where a is the coefficient of e in the proper transform [C] 
of C in F3, m is the multiplicity with which C passes through the vertex of 
the scroll. Because a — m and a are of opposite parity, the Riemann-Roch 
formula implies that either xi^PosC) or x{C) is not an integer, which is 
absurd. 

We conclude that all Castelnuovo curves are nonproblematic. The proof 
of Theorem 12.21 is now complete. 

2.5 Curves spanning hyperplanes 

Next, we consider rational curves C whose linear spans are 3-dimensional 
hyperplanes H C f"^. By 1)2. 2b|) . in order to prove Theorem 12.11 for such 
curves it suffices to show the following. 

Theorem 2.3. The reduced irreducible rational curves verifying 

g + i > 11 + inm{g, 5) 

define a sublocus of AIiq of codimension greater than g + i. 

We now argue much like we did in our analysis of nondegenerate curves. 
The analysis here is simpler, though, because the required bound on g + i is 
easier to obtain. Therefore, we give the argument, while omitting the proofs 
of results that generalize immediately from the nondegenerate case. 



35 



Fix C, and let Hi denote the linear span of C. Let H2 be a hyperplane 
in H that is general with respect to C in the sense that T := C fl Hi is 
a collection of ten points in uniform position in H. Choose coordinates 
for in such a way that H and Hi are defined by X4 = and X3 = 
X4 = 0, respectively. Just as we did for nondegenerate curves, we define 
the hyperplane gin of C to be the (saturated) generic initial ideal of the 
saturation of 1cnH]_/Hi and we abusively denote it by gin(2r). Just as 
before, because the hyperplane gin is saturated and Borel-fixed, it follows 
that gin 2r is a monomial ideal in xq and xi having a minimal generating 
set of the form 

By a result of Ellia and Peskine |Grel Cor. 4.8], the invariants Aj of the 
above generating set satisfy 

Aj — 1 > Aj+i > Aj — 2 

for all i = 0, . . . , A; — 2. 

Every Borel-fixed ideal with minimal generators that are monomials Xqx\ 
has a unique tree-representation analogous to the tree representations for 
the hyperplane gins of nondegenerate curves in introduced previously. 
Moreover, every tree may be obtained from an empty tree with a single 
vertex by applying a sequence of rules that we denote as before by A-rules 
(see Table EJ. A straightforward inductive argument analogous to those 
already carried out in our analysis of nondegenerate hyperplane gins shows 
that Aj is equal to the number of nonterminal vertices in a minimal 

generating tree for the hyperplane gin, which in turn is equal to the degree 
of the curve C. Whence, 

k-2 

^Ai = 10. (2.18) 

i 

On the other hand, by the main result of |Balj implies that Jr is 5- 
regular. It follows from (|2.18|) and the combinatorial characterization of 
Borel-fixity in [Ell Thm. 15.23] that the gin of a general hyperplane section 
r of a reduced, irreducible degree-10 curve C in is either Borel(x^) or 
(xf , xoxf , Xgxf , Xq). Define qy for these ideals as before; then a calculation 
yields g-p = 11 and gr = 12, respectively. It follows that 

g + i<llimdg + i<12, (2.19) 

respectively. 
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Table 3: A-rules for curves spanning hyperplanes 



1. Xq I y {xq^ ,XqXi), 

2. Xqx{ i-^ Xqx{~^^, and an initial rule 

3. 01-^ {xq, Xi,X2). 



Table 4: C-rules for irreducible curves spanning hyperplanes 

1. X^ ^ X^ ■ {xo,Xi,X2), 

2. Xqx{ t—i- Xqx{ ■ {xi,X2), and 

o e f Q e / 9 

Just as in the case of nondegenerate curves, a minimal generating set for 
the generic initial ideal gva[T(jiH) may be represented in a tree obtainable 
from the tree of corresponding hyperplane gin by applying a sequence of 
rules; these we denote as before by C-rules. The C-rules are given in Table|^ 

The same argument used for nondegenerate curves shows that for every 
C, h^{X(ji^{f)) is equal to the number of C-rewritings applied in degrees 
greater than 6. Finally, the long exact sequence in cohomology associated 
to 

^ Xp4(4) ^ Tc/P4(5) ^ Tc/h{^) ^ 0, 

shows that 

h\lc/H{^)) = h\lc/^4^)). 

With these preliminaries in hand, the proof of Theorem l2.3l is almost im- 
mediate. For, note that applying a single rewriting rule to either Borel(x^) 
or (xf , xoxf , XqXi^Xq) produces a saturated ideal that is minimally generated 
in degrees at most six, and is, therefore, 6-regular. Accordingly, our esti- 
mates 1)2. 19() improve to g + i < 10 and g + i < 12, respectively. Therefore, 
Theorem 12.31 is verified in every case except possibly ii g = 0. 

On the other hand, by |GLPl Thm. 3.1], C is 8-regular unless C admits 
an 8-secant line. An inspection of possible generic initial ideals in the second 
case yields that if C is 8-regular then i < 10. Therefore, Theorem 12.31 is 
verified in every case away from the locus of genus-0 curves that admit 8- 
secant lines. On the other hand, smooth rational curves C of degree 10 that 
admit 8-secant lines comprise a sublocus of the Hilbert scheme of rational. 



37 



smooth, and irreducible curves in H of codimension at least 5, by |JKll 
Lemma (2.4)]. In other words, by 1)2. 2b|) . the sublocus has codimension at 
least 16 in Miq. Theorem 12.31 follows immediately. 

3 Reducible curves 

In this section we'll prove the following theorem, extending |JKH Thm.4.1]. 

Theorem 3.1. On a general quintic threefold in P^, there is no connected, 
reduced and reducible curve of degree at most 10 whose components are ra- 
tional. 

Suppose, on the contrary, that such a curve C exists. By the results of 
|JKlj we may assume C has two components and is of degree 10. Consider 
one of them. By the result of |JK11 Theorem 3.1], either it's a six-nodal 
plane quintic or it's smooth. If it's smooth, then, by |JKH Cor. 2.5(3)], 
either it's a rational normal curve of degree < 4 or it spans P^. We will 
prove that there can be no such C. 

To this end, we follow Johnsen and Kleiman once more. Let denote 
the open subscheme of the Hilbert scheme of P'^ parametrizing the smooth 
irreducible curves of degree a that are rational normal curves if a < 4 and 
that span P^ if a > 4. Denote the scheme parametrizing six-nodal plane 
quintics in P^ by N^. Let Ra,b,n,S5^n, and S'^ denote the subsets of M„ x 
(resp., Ms x N^, x N^) of pairs {A,B) such that An B has length n. 
Finally, let Ia,b,n (resp., Jn,Kn) denote the subset of Ra,b,n x P^^^ (resp., 
S5,n X P^25^ s'^y^ Pi25) of triples {A,B,F) such that A C F and B C F. 
The F that contain a plane form a proper closed subset of P^^^; form its 
complement, and the preimages of this complement in the incidence schemes 
Ia,b,n, Jn, Kn- Now replace Jn (resp., Kn)- Replace S^^n and by the im- 
ages of those preimages, and replace Ia,b,n-, Jn and Kn by the new preimages. 
Then given any pair [A^B) in there is an F that contains both A and 
B, but not any plane. It remains to show that Ia,b,n (resp., J^, Kn) has 
dimension at most 124 whenever a + b = 10 and n > 1. 

We note that the fibre of Ia,b,n (resp., J„, Kn) over a pair {A,B) is a 
projective space of dimension h^{Zc{^)) ~ 1; where C is the reducible curve 
C = A\J B and Xc is the ideal sheaf of the corresponding subscheme of P^. 
Hence we have 

d\mla,b,n < dimi?„,b,„ + 125 - min{/iO(Oc(5)) - /i^(Xc(5))} 



38 



Obviously, we have 



(Oc(5)) > x(Oc(5)) 



which imphes 



(Oc(5)) > 5(a + 6) + 2 
(Cc(5)) > 20 + 5a + l 
(Cc(5)) > 20 + 20 -n 



n = 21 + 5a — n, and 
40 — n, respectively. 



n. 



Our theorem is then a consequence of the following two lemmas. 
Lemma 3.0.1. For a + b = d and n > 1, 



To prove the first lemma, begin by letting (A, B) denote an arbitrary 
pair in Ra,b,n- Fix B, and let A vary in the fibre of Ra,b,n over B. Assume 
that a <b, so in particular a < 4. 

If a = 1 or a = 3, then the lemma holds on the basis of the arguments 
in |JKlj . Moreover, if a = 4 then the argument of |JKlj carries over except 
in the case where i? is a sextic meeting A in twelve points along which the 
sextic intersects a hyperquadric containing A. 

To handle the latter situation, recall that the restricted tangent bundles 
Tp4,\A and Tp4\B have balanced splittings (5,5,5,5) and (8,8,7,7), respec- 
tively ( |JK1[ Cor 2.5]). Now fix a divisor Di of degree 7 along by and 
a divisor D2 of degree 7 along the sextic. The space of degree-6 morphisms 
pi _^ p4 mapping Di to D2 has dimension h^{T¥^\B (g) T/^J = 30 - 4 ■ 7, 
since h^{TF'^\B 'S1ID2) = (see |De[ p. 45]). As Di and D2 each vary in a 
7-dimensional family, it follows that those sextics B intersecting A in seven 
points cut out a locus of codimension 14 inside Mq. Since 14 is larger than 
12, we conclude that dimi24^6^i2 meets the required bound. 

Similarly, if a = 2 and 6 = 8 then by the argument in |JKlj we may 
assume n > 7 without loss of generality. Note that if n > 7, then in fact 
n = 7. For, denote the plane of A by J. Note that B spans P^, as 6 > 3. 



dim Ra^b,n < 5(a + 6) + 1 - n, 
dim Sa^n < 20 + 5a — n 
and dimS'„ < 39 — n. 



(3.1a) 
(3.1b) 
(3.1c) 



Lemma 3.0.2. For a + b = d and n > 1 



h\lci5))=0. 
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Let H be the hyperplane spanned by J and a general point of B; then 
\{H n i?) = 6 > n + 1. From 6 = 8, we conclude that n = 7. 

To bound the dimension of i?2,8,7i the space of unions of irreducible ra- 
tional conies A and irreducible rational nondegenerate octics B intersecting 
in projective schemes of length 7, we proceed much as we did to bound 
dimi?4^6,i2- Note it suffices to show that rational nondegenerate octics in- 
tersecting a conic in at least seven points have codimension at least 8 inside 
Mg. But just as in the analysis of i?4,6,i2> the assertion is clear since |JKll 
Cor 2.5] implies that the restricted tangent bundle Tp4,\B has balanced split- 
ting type (10,10,10,10). 

Next we treat dimi?5^5 „, where n > 1. Using |JKll Cor 2.5], we note 
that the 3-regular schemes A and B are each cut out by hyperquadrics and 
hypercubics. Therefore, 

hyiA{2)) = /i°(Op4(2)) - h'>{OA{2)) = 15 - (5(2) + 1) = 4. 

For degree reasons, no three linearly independent hyperquadrics containing 
A may cut out a complete intersection curve containing AU B. 

The only remaining possibility is that A and B lie on a nondegenerate 
cubic scroll, defined by three hyperquadrics. But in that case, any "fourth" 
hyperquadric containing A intersects the scroll properly, in a scheme of de- 
gree at most 6. So we conclude that some hyperquadric Q containing A 
doesn't contain B. Thus degree An B < degree B (1 Q = 10. On the other 
hand, Tji,4,\a has balanced splitting type (7, 6, 6, 6), from which it follows (by 
the same argument used earlier) that for all 1 < n < 7, the codimension of 
curves A intersecting curves B in subschemes of length n is equal to 2n. As 
dimiZs^s^m ^ dimi25^5^„ whenever m > n, and 10 < 14, it follows immedi- 
ately that no curve in R^^^^n-,n > 1 lies on a general quintic hypersurface. 

Now consider reducible unions belonging to dimS's^n, where n > 1. Let 
^ be a nondegenerate, rational, smooth quintic curve, and let -B be a six- 
nodal plane quintic with linear span J. The intersection A D J is proper, 
whence of degree at most 5; it follows that deg(^n5) < 5. Since Tp4,\A has 
splitting type (7,6,6,6), the codimension of curves A intersecting curves B 
in subschemes of length n is equal to 2n, for all n < 7. It follows that no 
curve in S'5^„,n > 1 lies on a general quintic hypersurface. 

Finally, consider a pair {A, B) in S^. Let J denote the plane of A, and K 
the plane of B. We may assume J ^ K without loss of generality, since the 
general quintic threefold F intersects J properly in a quintic curve, which 
shows that '\i J = K, then 

AUB (ZF 
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is impossible. So ^ U i? spans at least a 3-space. 

Moreover, it's clear that AO B C JOB, so An B has degree at most 
5. On the other hand, the restricted tangent bundle Tp2 \a has splitting 
type (01,02), where oi + 02 = 15. Assume oi > 02. As usual, our goal is to 
bound the codimension of those six-nodal plane quintics that meet other six- 
nodal plane quintics in 1 < n < 5 points using ampleness properties of the 
restricted tangent bundle of A. In particular, we are done provided 02 > 2, 
which is certainly the case. For (cf. |GLPj ). there is an exact sequence 

2 

^ Opi {-ai + 5)^ if°(Opi (5)) (g) Opi ^ Opi (5) 
1=1 

which implies Oj — 5 > 0. The proof of the first lemma is now complete. 

We now proceed to the proof of the second lemma, i.e. that all curves 
C in rational components A and B satisfying our hypotheses are 6-regular. 
First say A and B are smooth. It's a well-known fact (see, for example, |(Tri| 
Thm 2.1]) that 

reg AU B < reg A + reg B, 

so we need only establish that A and B are 3-regular. But this follows, e.g., 
from the result of |JK2l Prop. 2.2]. (See also the discussion following the 
proof of |.IKH Cor. 2.5]; the key point is to observe that the components 
Ci of C are necessarily of maximal rank in every degree for the canonical 
morphisms H^{Op4{k)) H^{Oc,{k)).) 

In the only remaining case, A is a smooth rational quintic spanning 
and B is a six- nodal plane quintic. In that situation, C = AU B is 4-regular, 
by the "Horace lemma" tJKl| Lemma 4.5]. 

Therefore, we may assume A and B are plane quintics. Once more, we 
treat separately the cases where rank C = 3 and rank C = 4. 

If G, the linear span of A U B, is a 3-space, then G Ci H is a plane 
containing K, and is therefore equal to K. Hence 

CnH = {CnG)nH = cn{GnH) = cnK. 

On the other hand, we have 

{AuB)r\K = {AnK)UB. 

Indeed, the latter equality of schemes is equivalent to the following equal- 
ity of ideal sheaves: 
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Any element I belonging to the left side is of the form l = a + k = b + k 

where a E Ij^/pi, b £ Ib/p-^i ^^'^ ^ ^ ^x/p-*. The inclusion I G Ia/v^ '^^k/v* 
follows immediately, and we also have I € Ib/f* because Ik/v^ C Ib/P"^ 
from the inclusion B C K. In the opposite direction, given r = a + k = b, 
we see that a = b — k E Ib/f*^ again from B C K. Since a general quintic 
threefold F contains no plane, we may assume Au B <Z F but K lies outside 
F, so F n K = B hy Bczout's theorem. Then A n K C B, and it follows 
immediately that CnH = CnK = B. 

In what follows, we let D denote C H H. To compute h^{lQ/f>4{5)), we 
use the exact sequence: 

To bound the cohomology of the middle term, we bound cohomology on 
the right and left. Note there is an exact sequence 

Ir/h ~^ ^D/H ~^ ^D/K ~^ 

with Ik/h = Oni—^) = Cp3(— 1) and Id/k = Ok{-5) = Op2(-5). It fol- 
lows immediately from Serre's theorem that h^{lK/H{'^)) = h^{^D/K{i^)) = 
for all integers m. Similarly, there is an exact sequence 

IjjpA ^A/W^ '^A/J 

with Ta/j = C'p2(— 5) and Xj/p4 = C'p4(— 1)^, and hence /i^(2'^/p4(m)) = 
for all integers m. 

Finally, say C = AU B is nondcgcncratc. After having made an ap- 
propriate change of coordinates, we may assume that J and K intersect in 
the point P = (0, 0, 1, 0, 0) and that the homogeneous ideals describing the 
embeddings of A and B inside are given in coordinates by 

Ia = {x3,X4:, f{xo,xi,X2)) and Ib = {xo,xi,g{x2,X3,X4)) 

for some trivariate homogeneous quintic polynomials / and g. Since A and 
B pass through P = (0, 0, 1, 0, 0), / and g, which vanish at P, do not contain 
X2 in their expansions. 
Note that 

(xa, X4) n Ib + f{xo, xi,X2) n C n Ib- 

On the other hand, given any element e G Ia^Ib^ viewed as a combination of 
X3, 0:4, and /(xo, x\,X2) with polynomial coefficients, any terms of e divisible 
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by f{xo, xi, X2) automatically belong to Ib, since / does not contain in its 
expansion. It follows immediately that e = 61+62 with 62 € /(xq, xi,X2)r]lB 
and ei G (2:3, ^4) n Ib, and therefore that 

{x3, X4) r\lB + if {xo,xi,X2))n Ib = {x3,Xi)nlB + ifixo,xi,X2)) = Ia^Ib- 
Continuing in this vein, we deduce that the homogeneous ideal of C C P"^ 

is 

Ic = Ia^Ib = {x3,Xi) n (xo,xi) + {g{x2,X3,Xi)) + (/(xq, xi, X2)) 

= (xiX4, X0X4, X1X3, X0X3, /(Xo, Xi,X2),g{x2,X2„Xi)). 

We will now show that 



where It(-F) denotes the leading term of a homogeneous polynomial F with 
respect to the revlex order, and in(/) denotes the ideal of leading terms of 
the homogeneous ideal /. 

We will deduce the latter inclusion as a consequence of |Gre[ Prop 4.3], 
which establishes that for any two homogeneous ideals / and J, if 



(X1X4, X0X4, X1X3, X0X3, lt(/), lt(5)) 



m(/c) 



in(/) n in( J) C in(/ n J) 



then in(/ + J) 
Now let 



in(/) + in(J). 



/ — ^ ^ 0-ijkXox\x2', 



since = (0,0) is disallowed, we have 



X3/ e (xiX4,XoX4,XiX3,XoX3) fl (/). 



So 



lt(x3/) = X3lt(/) G in((xiX4,XoX4,XiX3,XoX3) H (/)) 



and similarly 



lt(x4/) G in((xiX4,xoX4,xiX3,xoX3) n (/)). 



On the other hand, if 



— 0,ijkXljX'[x2, 

then xsaijkXQX-[x2 and X4aijkXQx{x2 generate the intersection 



in(xiX4, X0X4, X1X3, X0X3) n in(/). 
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(This is clear, since any monomial e belonging to the latter intersection is 
divisible by one of the monomials xix^, xqx^, xix^, xqx^, hence by X3 or X4, 
and also It /. Thus e is divisible by x^lt f or X4lt /.) So in fact 

in(xiX4, X0X4, X1X3, X0X3) n in(/) C in((xiX4, X0X4, X1X3, xqXs) n (/)). 

Therefore, 

in(xiX4,XoX4,XiX3,XoX3, /) = (xiX4,XoX4,XiX3,XoX3,h(/)). 

Essentially the same argument shows that 

in(xiX4, X0X4, X1X3, X0X3, /) n in(5f) C in((xiX4, X0X4, X1X3, X0X3, /) n {g)). 

We conclude that 

in(xiX4, X0X4, X1X3, X0X3, /, g) = (X1X4, X0X4, X1X3, xoX3,lt{f),lt{g)). 

Since there is a flat degeneration taking Zc to in 2c ^ and the latter ideal 
is generated in degrees at most 5, we conclude by the basic regularity result 
of Bayer-Stillman [(irrel Theorem 2.27] that 2c is 6-regular. 
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